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ABSTRACT - , 

-■■ ^ . The process of stfidying text material is a 

criteria-related', self -directed form pf. steading involving three 
phases: prereading, reading, and postreading. Prereading consists of. 
clarifying the criteria for study, constructing a study guide, and 
surveying the text to determine how much is already known, how 
interesting it is, and how difficult or time consuming it will be to* 
learn what needs to be known. The reading phase includes extended 
reading, monitoring under'standing of., text meaning, and remediating 
important comprehension failures as they occur. Postreading 
activities augment what hai^ already been learned and generate useful 
alternative texts, such as notes and outlines. Happing can be part of 
this final istage and involves an elaborate outlining system which 
ju'xtaposes related ideas and indicates the nature of their 
relationship by a symbol systemi (TJ) _ ' 
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STUDY SKIU.S AND LEARNING STRATEGIES / 

In this chapter, the process of studying text material is viewed as 
a criteria-related/ self-d i rected forfn of reading text. It is a form of 
read ing.unl ike reading a novel for entertainment or reading the newspaper 
to pass time on a commuter train. J^ather, it is a form of reading in 
which specific i.-ritormat ion must be gained -by 'engaging a text or reference 
book in order to perform well on some future event', such as taking an 
exam, giving^a speech, or writing a paper. ^ 

The other impdi;-tant feature of studying, as i t will be discussed in 
this, chapter, is" tl^^t it is student-di rectecf. The student is ^he prime, 
agent in deciding when and, how the study sessions should proceed. In 
contrast, other types of studying, such as teacher-directed, computer 
managed or programmed, instruction, provide the student with decisions 
about what- to-dor next. 

To help describe. the prqcess of studying, the .concfept of metacompr^- 
hension is used frequently in t"Kis chapter. Accordi^ng to'Flavell (I978), 
a broad^def ins tion of metacomprehension is' "knowledge or cognition that 
takes as its object or regulates any aspect of any cognitive; endeavor." 
For the needs pf this chapter, however, some of the more specific charac-^ 
teristics of metacomprehension, e.g., cognitive monitoring and comprehen- 
sion failure, are crucial. These are key concepts oip student-directed 
studying, since stuc^^nts must re 1 iably mon i tor thei n oWn acquisition, 
maintenance, and production of knowledge. The notion of metacomprehension 
is woven into each r.he three major sections in f 1^ ^ h i»Ler which dj^- 
cuss the Pre-rending, During Redding ^nd Ppst-rt iv^tivities involved 

in the process of studying. 



. -2- . 

Stage I: P re- reading Act ivi ties 
The fH^st stage of Pre-reajing* act i v i t i es begins when the student has' 
' resolved* some of the motivational aspects of studying (e.g., Do I have time 
to study? Am I too upset to^ study? »Are there easier ways to jearn this 
mat;irial?), and- is convinced that-the textbook must be engaged in order to 
learn. Once the decision has been made to engage text, the student must 
clarify.the criteria associated with the study session. The following two 
sections discuss some of the processes .that students can apply to aid them 

in clarifying criteria.- * , 

■ , ^ ^ \ - ^ ^ ' • ^ 

Clarifying the Criteria and Objectives of Studying v 

Whi le studying can occur- for many diveVse reasons, most often students 

» • • ■. • • ■ . * • ' . \ ■ 

engage in textbook^studying to prepare for an e^ami nat ion . / Al so, . textbook 

• • . ' » 

; studying is seldom i'soVa ted fronj other instructional components of an edu- 
cational system, such as lectures, computer-assisted i nstruct ion , lab9ratory 
work, and discourse with classmates and teachers. In the Pre-reading stage, 
ihe pi*iine task of the student Is to apply knowledge gained from these^other 
instructional sources in order to help specify as clearly as possible the 
nature of the forthcoming examination. In other words, the students need 
to determine what topics will be tested, as well as^ thc^ expected levels^of 
understanding of each topic. ' \ • . y ' . 

The most readi ly ,avai lable^sources of information to help students . 
deciJ^ on the nature of the. fctrthcoming examinat-fon^-are- lecture notes, \ 
course guideis and object i ves and copies of previously administered exams. 
Th'e student's job is to organrze these materials so that they will>be 
maximally usefu^ cages In the study sn^'^ in 

One ^u^gest.ed organizational techniquie is to deveio} uudy guide 
upon' which subject matter entries can be made as they are encountered. We 

y ^ ^ ^ • \ - • ' / ^ • . , • . . ' ' ■ . ■■ • .. ' 



have found it useful' -to have one'sheet set asicj^e for all potential te*st 
items which wil'l require students to name, describe, define, .or gi-ve ' 
.examples^and applications* For example, when an instructional objective 
stated that the student will be able to identify Copperheads, describe 
the Battle of Shi lofr thurch, or when a test item requires t|ie student to 
list two important safet/ precautions when using an*^ arc welder, then the 
student would wri te. Copperheads, Shi loh Church and arc welder-safety on ^ 

• ■ ■ 

•the study guide. 

„...'■ ' * f 

On a second page labeled '*'C-ompari sons,*' the student lists those topics 

which'- require a "compare and contrast*' level of understanding. items from 

lisljs of objectives, and te^sts such as, "Discuss the effectiveness of Davis 
'1 ' • 
• . \ •\ * • • ' • 

and Lincoln as military leaders," or 'Vhat was the'major differenae between 

the United States and tWfe' .Corifederate States^ cpnsti tutions?" would be 

entered onto--the study guide as "Davis vs. Lincdln" and '''U.S. vs. C.S. 

const I tutions.'i 

Onto a thiAl' study guide page* would.be entered those- items which have 
a temporal, procedural, or causal relationship. Items such as, "Why did 

the people in the South mourn Lincoln"' s assassination?" "Why should all 

* • 

arcwelding hardfadng be done in a f lat posi tion?" or, "Before checking 

to see that the vol tage is zero, what should be dohe?" would be entered 
as "'Lincoln's assassi.nation ■ ^ South mourning"; "flat position — 
hardfacing"; .and*" — -.^-voltage is zero." ^ ' , 

^ Final ly,. a fburth study guide page would* contain thosje items which 
would not fit conveniently onto the' first three. Those< items which re^ 
qui re complex tasks such as analyting, evaluating and criti<quing would be 
included on this fourth page. Our prelimi nary work with this technique 
indicates that d student Ccin translate 40-items from a multiple-choice 



test onto these worksheets in about 15 minutes. We believe. that this is 
not an unheasonatle amount of time to ^pend on this t^sk. 

' In silimmary, this Pre-reading activity requires that the-students trans- 
late items from tests, lists of pbjectives, and lecture notes into topic 
entries and write them on the proper stifdy guide page. Constructing these 
worksheets' is a technique that aids in organizing the pertinefit information 

■ i . * •■ ■ ■ . 

f 

related to; the study ' cri ter ia. Another valuable source for gat^er^'ng infor- 

' ' /' 

mation is the textbook. The nekt section describes how that proc^edure works 
Su^ey i ng 

'It is easy when reading some of the most influential **how- t.o--study'' 
literature (Robinson, 1970; Pauk, ^S^k) to be lulled into thinking that 
surveying is^ a straightforward, rather non^ involved' process. Many authors 
suggest that students read the titje,' rea?l the subtitles, look at the pic- 

■■ _ ■ . 7 • ... V ■ 

tures, read the summary, etc. whi le/ quickly turning from page to page 

throughout the chapter. Seldom are these suggestions described in enough 

detail to inform the student on what information is supposed to be found 

in the title, the pictJ4jres or the summaries. • 

* ^ , 0. • 

' * -0 * ' 

In an effort to gain more insight into surveying and fo beg^n farmu- 

.. . .\ .. 

lating a first-order model of this process, we gave twelve, sk'i 1 led ' readers 

o ■ • . • ' > • _ 

a chapter each to study in preparation for a Jater event, such as taking a 
test or atten'ding a lecture. We contacted each studier in advance 'and . 
asked them to set aside approximately a one-hour block of time 'in ^n 
effort to make the task derpands as realistic as possible. To start the 
study session, ey were told that they should study in prepar«iUion for 
either a. test to follow, or to attend .a lecture. Then the^text was given 
to them and their initial behaviors were observed. .Specifically, we o 
"wanted to know whether or not they would attempt any type of survey 



activity; and second, we wanted to know more about the coq<^ I tive processes 
iavolved.in the surveying activity. The following model/was generated 
from this source of observant ipna 1 and sesjf-report data/ 

We discovered that virtually every one o<.thg^ subjects attempted 
some form of survey. The shortest survey wa$ only 10 seconds, and the 
longest was in the rahge of 15 minutes. During these relatively short 
periods of interaction with^the text, a number of very complex behaviors 
and procedures took place. We tried to capture the gist of most of our 
observations and st^ent reports in the three questipns which students 
seemed to be attempting to answer as they surveyed. These ques]tions arte: 
(1) How much do I already know about thi-s topic and text?, (2) How int^r- ^ 

■ y * " 

ested am I in this topic and text? and (3) How di ff icult;^ or time-consuming 
will it be for me to> learn what I need to know from the text? The evi^ * 

* ' ■ ' . ( 

dence.that stijdents wer^ seeking in order to help answer the questions came 
from a number of sources, and our categdrization of these sources leads us 
to the next, descriptive part' of the model. " : 

The first level of i nformat ion that students attended to were the 
salient, infarmation-r i.ch, non-sentence parts of the text chapter. These 
parts include the title, subtitFes, marked words, higMighted sections, 
|i>ictures, charts^ graphs, maps, anu reference lists. Most textbooks make 
It easy to quickly locate such information with only a glance at e^ch page. 
A brief pass through a chapter in which the student i nspected only these 
types of information typically took 'two minutes or less. The second level 

ci 

c * 

of information that these students attended to vjas information-rich por- 
tions that are in predictable places in the text and can be located 

rapidly. This kind oT information includes .introductory and summary para- 

- • - " " r . 

graphs, the first and last paragraphs in the subsections, and the fipst 



sentence af any paragraph. To engage in this second level of. information 

f ' . - , .* 

gathering. req4ji fed ten to fiteen minutes in a^'typical chapter. ' In a third 
^^level of activity /during the survey, students engaged \s\ selective reading 
of larger parts of the text. For example, they may have read most of a 
subsection, ~dr perhaps, several consecutive paragraphs." 

The process of using these three levels of information , to help answer 
the three "How-f" questions, Ms a very dynamic and complex one. Seldom did 
a student survey jusj ng J nformat ion only at one level . For example, almost 
no dne read only: the title, subtitles and inspected Ihe charts, figures, 
graphs, etc. In'stead, the students moved very rapidly among the several 
levels of information. The movemefht among the levels, however, did not seem 
to be random, and the following model accounts for some of that, behavior . 

(1) The students i n i t i all y • fengage Level '1 in order to answer 
the three questions. * ' " 

(2) They wi 1 1 move from Level 1 to Levels 2 and 3 Jf they 
cannot reliably answer the three **How- 1*' questions by 



using Level T, or the material is particularly^interestihg 

V . ' y ^ . .... 

\ to them. * . ' ,^ 

'.• '(3) ' The^ stud-entfi ^i 1 1 move from Level 3 to- Levels 1 and' 2. if 

they iirc able to reliably answer the questions, or if the / 

text becomes less i nterest'mg. 1 

■ i - ..V .. . . ' ' ^ * ■ 

{k) If the text is not formatted to facilitate using Levels 1 

i * ■ ■ > . 

and 2, i.e., the^ text has only paragraphs withrio headTng^ 

' ' t ' * • 

1 » * * ' i 

or format markings of any kind, then the surxeying process-, 

. breaks down and the students try some other strategy , such - 
, ••• •• ■ . * ^ 

as starting at the beginning of the passage arid carefully 

• V . ' ^ \ 

reading each paragraph. ■ \ 

■ -- , , ! »V 



/ 



. * In addition, our observations have Ted us to believe tWt answers to 
the three /'How-M^^^^ can be used to make predictions about how wetl 

the vstudy- session will proceed. The study session will stop after survey- 
-^ngl (1) when the subject already knows' the content, and/or (2) when the 
subject "s very uninterested in the topic, and/or (3) ^hen thd time re- 
quired to learn the text greatly exceeds the time availabje for: study. 
Also, the study session wjH probably be of limited duration wh^n Interest ' 
in the topi c and. text is, at best, Vow and di f f icul ty o,f the topic is high. 
The study session will proba\^]y proceed smoothly under the ^fol lowing c^n- 
ditions: (l) when at least some,' but not all, of the text material Is 
already known, (2) when the topic is somewhat interesting, an3"(3) when 
the time estimate to leafn the required jmatorial is low to medium. 

' n ' - i * • 

In many respects the process of surveying is much more complex than 

that of reading and studying the text itself, as described in the next 

section. Stage II.' Skilled stddents'use rich (but .terse) information 

from the text and from their own knowledge, pf the world to make decisions 

about their own level of understanding and attitudes toward the text and 

topic. ^ Ski 1 1 ed readers can do this in a very short period of time, usually 

on^tfTe order of a few minutes. 

• * > , > ■ 

Stage'll: During Reading Activi^ti^s 
After clarifying the nature of the studyfn^ outcomes and constructing 
a study guide, reading extended tjext can begin. Frequently, there is a ' 
distinct bre.ak in the "flow" of studying behavior between Stages' f and I I . 
That i s , students stop looking rapidly through the chapter as-in surveying 
and start at . the beg i nn i ng to read • each sect i on . Somet imes , however , 
students , never move out of Stage l;\£his happens when the stu4y^ng criteria 
are explicit enough to enable 'a ^tudent to rapidly locate and 'read the 



■8- ' 



relevant sections of text while sucveyipg. Occasionally, for example, the 
charts and graphs will contain'all of the necessary information; this' is " 
often the case with technical manuals. When the situation arises in which 
students must engage larger chunks of text and must proceed to Stage M, 
a'metacomprehens ion. model of studying is proposed to help account for the 
diversity of activities whigh occurs. 

' * ' ' 

In this model the student engages in a sequence of instructional 

• * _ 

episodes. Most episodes include the following components: (l) information 
gathering, (2) student responding. (3) response judging and feedbacl<, and 
(A) making decisions concern i ng- what-to-do-next . An example of a short 
episode would be a frame in a programmed instruction text. In a programmed 
text a short chunk of information is presented, '.a question is asked, and 
the student provides an answer which can be compSred with a "preferred 
answer" printed elsewhere in the text." Feedback and directions about 
what-to-do-next are provided. Xhus.^ a programmed texi^frame would be a 
prototypic example of a short instructional episode where only a limited 
amount of metacomprehension is required. 

As previously menftbned, the focus' of this chapter is to consider 

:-rjdying as a sel f^di rected form of instruction. To study effect i vel y 

• . ■ 

the student rnust know when and how to use each component of the model, 

*t - * 

and to do this well- requires that the student be a goo^l-^metacomprehender . 

Some forms of instruction, such as teacher-di rected« or computer-managed 

Instruction, , use other techniques to substitute for metacomprehens ion . 

For example, students engaged in traditional computer-managed jn^tructio^ 

do not of ten have to ask the question , '*Do I know if I understanc^ this 

material?*' During each episode the computer informs the- students whether 

or not they understand {he materi'i.l. The next sections describe the way 
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in which the fouY components apply' to studying , aTdng wT th^^ 
some 'relevant research- ' . 

Information Gathering <. ' 

An instructional episode begins when the student starts reading to 
extraf:t meaning from sentences and paragraphs irj a more or less sequential 
order. When students have an orgajnzed study 5id, such as the study guide 
described earliery it can ,be used to help generate text-specific search 
markers, i.e., reference points where reading should start and'^stop. In 
•other words, students can be more selective in what i nforma_^t ion they choose 
to* process. 

The skill of se lecti ng - i^porfant text sections to read carefully is a 

very MmpD'r tan t ^ne when considering^ the sheer jnformation load of a text 

*■ ■ , / 

chapter. For example, the number of so-called idea units i'n a typical - 

chapter of text is minimally 50 per page. To calculate this we used a 

conservative technique; similar t^ one for ca leu lati ng pausal units (Brown 

& Smiley, 19.77), in which' we defined an idea unit as that verbage bounded 

by punctuation marks , conjunctions , and/or infinit'ive phrases.! Commas • 

which were used to set-off members of. d list ^)r a cl ty-st'a te* ct)mbi nat i on 

were not used': ^ Using these data, a 30-page chapter would- havej at a 

i — — «— 

\-5 ^ ^ ' * i 

mini munrT , aboOl: 1500 pausai units or id^as. • 
^ To determine how students col l^t '^information from extended text. 
Reynolds, Standi ford and Ander§on ^(1J)78) had college students read a 
text at a comj^uter terminal in an inserted quest ion' research parjadigm 
'Using the terminals allowed measurement of reading times on shorjt segments 
of material. They found that the question groups performed bettfer, rela- 
tive to controls^, on post test i tems that repeatJed inserted questions , ^ as 



^1 las t)n- new 4>ost test from the same,^ categories as the inserted 

questions. Analyses of time data shewed that there was no overall diffjer- 

ence in reading tines between the two groups—those who >iad- inserted ques- 

« 

tions and those who did not, but subjects who received inserted questions 
spent more time on the parts of the text tha.^ <iontained information of the 
type needed to answer the questions. In other words, student^ modified 
their information gathering processes in accordance wi t|i 'the task; -as c 
defirtecKby the inserted questions, ' ' . ' 

In'another experiment. Baker (1978) presented passages containing 
designed confusions, i,e,, contradictions of information involving main 
points of the passage or involving passage details^, to subjects at a com- 
puter terminal. After reading tha passage^ subjects were given a series 
of on- 1 ine quest ions to assess their awareness of the confusions. Tiiey 
were first asked to decide which of otwo alternatives was most consistent 
with each passage, where the al lernatjves^were. paraphrases of either the 
contradictory farget or^rts^^^frespoiidi ng non-confusing control statement. 
Depending on' v^ch^^answer subjects gave*, they were automatically branched 
by thfu-ct5mputer to further questions probing their i nterpretat ?ons of the 
passage. . 

Results showed that subjects spent mo'r£: time reading paragraphs with 
contradictions than those without, contradictions if the contradiction 
involved a main point. However, when the contradictions involved passage 
details, subjects spent less time reading the paragraphs in^tvhich the 
contradictions appeared than those without contradictions. Thus, subjects 
wer^* sensitive. to the contradictions and therefore altered their reading 
behaviors in an unexptected^but defensible, way. For example, ait appears 



Chat the- subjects did, in fact notice the contradictions on detail items, 
but decided to gloss over them rather than take additional time to re- 
• solve them. ' 'i ~ ' - 

; ■ 1 ■ ■ 

This sect loij on irfformation gathering is not meant to be an exhaustive 
'review but rather, an attempt at* i 1 lustrating some of the variables which 
affect this process. Thus, Tt is rather clear that the nature cf the task' 
demands as welV as° the interaction of clarity of presentation and impor- 
tance of information influence information gathering strategies. 
Stgdent Responding ^ 

This secon^, component in an instructional episode requires that the 
student stop gathering infor^mation and engage in a response-demand event. • 
In general, two type^- af mechanisms ,c>;h interrupt the information gathering 
process: (l)^a response--demand event initiated by e i ther -the studen t or 
teacher (human or computer,), and (2) 1:h>-Automat)c Monitor^-ng Mechanism 
(AMM) which provides students with "noises" Concern ip§--tii^M-^tudy i ng " 
comprehension, cal led "clicks" of comprehension and "cli'>'<s" of compre- 
hension fai lure. This notion will be elaborated later. 

A, major, well researched form of response-demand eyent is the use 
of -adjunct questions. The so-called d i rect effect of adjunct questions 

I *.- . '\ 

• ^. • 

occurs when students receiving adjunct questions performed better on 
criterion questions which are iientical to those used in the adjunct form 
than students in a read-onl y cond i t ion . There is also an indirect effect 
of adjunct questions: a superior performance by students receiving adjunct 
questions' on new criterion questions which were not used in the adjunct 
form compared wi th /the > performance of students in the read-only condition. 

Recently Anderson ind Biddle (l 975) rev lewed I i terature ^on adjunct 
questions and concluded that the Use of adjunct questions generally has a 



tfacilitative effect on learning from prose. Wh'en the questions are,placed 
after the text read by the students, they have a significant faci'litative 
effect on the repeated items and on the new items, showing difect and in- 
direct effects. When adjunct questions appear before the text the stu- / 
dents are to read, they have a pos i t i ve . d i rect effect^ but a negative 
indirect effect. In addition, the closer the questions are physical ly 
located to' the information to which they refer, the higher the perfor- 
ra^ce when those qulSstions ar<i^ repeated latec;. Moreover, when questions 
are grouped together after even lengthy prose, such as at the end of a 
chapter in a textbook, they can have a pronounced direct effect. When 
students are required to provide an overt answer to the adjuncjt questions, 
there are more cons i stent 'pos i t i ve direct and indirect effectS'^than when 
students are required to make only a covert response . Wheh the adjunct 



questions are higher level questions, i.e., they require the stiiclent to 

. ' ■ . • ~ 

go beyond 'the surface meaning of the text in order to answer .the question,' 

they have direct and indirect effects. The point is rather ^lear that 

. ' ' ' ' - ' ■ ' ' ■ t' " 

adjunct questipns can 'play a strong faci litative role in stCidying and 

learning t^^xt material 

1/1 a (related line of research in which students ar^ required to 

engage in^a response-demand eveht, results from recent . investigations on 



student-gelierated questions by Frase and Schwartz (1 975) ij^Schmeiz^r (1975) 
and Duel I (^1977) ar^^ encouraging. These researchers^ present four studies 
'which .sihow that when students (fiigh school and older) forlmulate questions 
during study by either writing them down or verbalizing the questions to 
a friend, they scored significantly better on a ppsttest. than students who 
Studied using various other 'control led techniques. 
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Andre and Anderson (1978) report another stu<ry using studs^iygenerated 
questions in wKich some of the controls and ^iihniques used by the previous 
authors were relaxed. Duel I (1977) reqi^if^ed studentS»;.to generate multiple- 
choice items rather than constructed-l^esponse type-, items. Frase and 
Sphwartz (1975) used text material whfch was so factua 1 1 y dense that vir- 
tually all of the students' questions were about specific facts. Andre' 
and Anderson (1978). on the other h^nd, taught students to generate open 
ended questions concerning the main idea of each paragraph as they' read it. 

In a f irst experimentaj study, a' randomly selected group of . students 
was trained to use the, question generating tehcnique. Another group of 
students served as a control; these students were g,iven the same series 
of training passages 'to practice on as those 'g.iv'en to the experimental 
group.. However, this control group was not told specif ical ly how to 
study the materials. On a second day, all stud^s were given a new 
passage to read and study, followed by a criterion test whic.h measured 
sfudeftts' knowledge of impdrtant outcomes. " Resu1 ts. f rom this study showed 

\l \ • ' ' 

that there was a significant interaction between students' verba 1 abi 1.1 ty 
and the effects of the strategy they employed. Specifically, the higher 
verbal .abi 1 ity students showed no significant gain by using the student- ^ 
questioning technique over whatever other. techniques they employed. The . : 
difference was seen - i n the .students wi th less verbal ability; they showed ' 
a significant gain by usin^^ the questioning techni^que. ' . 

' " :■ ■ \ 

In a second study, the same two treatments as used above vtere em- 
•ployed with the addition of a third. ^This additional group^ was n^t trained 

to use the questioning technique, as was the experimental group, but the'^ 

. '"^t ■« ,■ 

untrained students were asked' to try ttie technique on the. cri tex ion . 



materials.. Results fr^m this study show that both groups using the ques- 
tioning. technique s.cored higher than their control group. .Results also 
reveal a Treatment by Abi J ity level interaction, indicating that the lower 
verbal ability students benefitted more from the treatment than did t;he 
higher verbal abi 1 i ty students . * 

Another I fnding from these studies shpws,that when students con-. . 
Structed a good questiop about a mai n poi nt , the probabi 1 i ty was twice as 
great as opposed tawhen the^ were riot able to construct one, that later 
they cou^d correctly answer a questidh on the cri terlon test, concerning 
the main, polfnt. 'This finding is viewed- as evidence that thS. quality of, 
, students* questions can serve as a comprehension moni toring i ndex for the 
student at an important time 5n the study process when the student can take 
action to learn the material better. That is, i f the student cannot easily 
generate a good question, then i t may be necessary to reread the text / 

section or consult another source. In addition, thi s technique provides 

c ' ■ ' • " . - % 

the student with a record of questions that can be studied in preparation 
for a later test. ' *^ . 

. Of course, many students engage in the more fami'l i ar types of response 
demand events such as notetaki ng, under? 1 i n i ng and out 1 i n i ng . There is a 
long history of research on the effects of these ki nds gf act i vi tiesvand, 
in general, they are "not very faci 1 i tat i ve (See Anderson , 1 978) . However, 
these activities are shown to be facilitative if they generate an extensive 

■ ..■ ■ o ■ . . ■ ■ T'v ^ ■" ' * ' ' ■ ■ 

alternate form of the text whi ch can be used Tor future reference because 

-. - ' . ...... ^ ^ . . ■ . '"'c- 

the original /source (1*^ will not be available later, (2) is very lengthy, 

and/or (3) is not appropriately organized with reference to-^bme cri terion. 

A Jandmark- study by Barton . (1 932) i 1 lustrates this point. He^ught ^ 

nInety-six h)gh school students from two scljpols the f undamental s of 



outlining. The prime objective of the i nstructien was to teach the stu- 

dents to find main,, subordinate, coordinate, and irrelevant points in 

• ' • ' . <? . ■ 

' each, paragraph; Students^ applied the out 1 i ne. strategy to subject matter 

contents of geography, American history, and ancient history. Test per- 
formance of the students who used the outline strategy for a semester was 
significantly higher than test performance from a matched group who had 
a similar instructional program excluding the out 1 ine training, this is 
the most impressive study in the literature and demonstrates , With- few * ' 

: " ' ■ ■ • ; , ^ . ■ , J 

reservations, the beneficial effect of a student generated study aid. 

■ ■ " *' * . . * 

In summary ,Y there is evidence ''that when students stop reading atid 
respond to questions, generate questions or Construct extended outlines 
or paraphrases, learning f rom j^rose is facilitated. However, pau^trTg 

briefly to underline or to jot down brief^Yiotes typically are not highly 

, ■ ' r.. • ■• - • ' ^ 

effect ive form* of; response-demind events. " 

Another mechahi^sm which can aI nterrtTpt students while reading text 
is the so-caHed, Automatic Monit^riHig Mechanism. .It is called "automatic** 
because it seems 1;6 operate at ;a(^subawareness leVe^arid the student is 

7 ." ■*•■*' * ■ • .. 

only aware of i t^voperation after it. has" made its noise;s', i.e., clicks artB^- 
clunks. In an initial investigation of the AutonTSt i c Moh i tor i ng Mechan i sm, 
we observed and quest ioned graduate students as they engaged In study. /> 
WhiJ.e we were aware that this technique'would iritrude on and possi biy 
disrupt the study .process , 1 1 seemed to be a good method for indexing 
many of ' the otherwi se covert processes. To date .we have col lected inter- \ 
view data, from eight students. Our most heavily consf'ricted technique 
required each student to read aloud ;tb,' predict the content of each 
'paragraph prior to reading it jn depth; to summarize the paragraphs after 
reading them; and, to relate all other thoughts concerning the, study 



session. -Our most lenient technique- requi red each student to study normally 
and to place a quest ior> mark beside any section of text that was confusing 
and/or slowed down or stopped the reading process. After studying the text, 
all studentVwere given a test over the material and the nature of the ques- 
tion marks and/or notes was discussed in aposttest interview. " 

The fol lowing observations are jesul-ts of those interviews, (1) The"*" 
f I rs t techn i que d i scussed>above--heav i 1 y cohs t r i cted techn i cfue— was so h i gh 1 y\ 
iateracti\/e that; it seemed to becoftie -a leaVning stralfegf ^ i.e; , the 

students seemed to lea>n more from the exchange w| th the %erimenter'=than 
from^the text itself, \ (2) During the post-studyMnterview, students coulfV^ 
.discuss in detail the nature of the quest ion marks tl^lt they entered on tlje 
text whi le s^'tudying. Coa^quently, we were not required to interrupt the. 
study process by request! ngXr^^^^ from students. (3) Students have a 
^rather well established study ^^^-^^r^^ti^y ^hat is not easily modified by tilling 
them about various task demands brr^^^^^of. ^studying material?. {k) Students 
c«ii Ir-pose temporary meaning on novej vx>I^^J^2Rl^^ v 
te;. rwl^ir the intention of clarifying the meanTr^^^^^^^^^^^^^^g^^ 
Ifgnorirg n if unhnpo 'cant. In. gerieiraU^^students employ ■ -e^i-FeSy^^^S^ 
ticated&trategies concerning the semantic importance of text that they 
encoi^nter. For example, words, used in foothptes or Vords not essential • 
to understanding the gist of a sentence were* u^ual ly c^^^ 

that, and their meanings were seldoitj veri f ied in a dlctiorrary or glossary'. 
(5) StHdents f\aa trouble remembering, to writ'e the quest tpn m^'rks when they 
were confused. They reported that Having to remember placing-' the question 
marks Interfered wi th studying. (6)" Students exhibited many emotional 



behaviors^ i.e., smiles, I'rownS;, muscle tension, perspiration, and a ' 

I . ■ . . ■ • 

general emotional fatigue after the study session. . 

• ' ■ /. . • ■ ■■ . ' 

J In conclusion, we saw these study sessions as a series of very 

sophisticated cogn i t ive/ arid enfot i pna 1 processes whi'ch are difficult to ^ 
monitor and are -genera /ly below the student's level of awareness. Occa- 
sional ly th^se processes reached an awareness level >in the form of the 
previously fnentioned click of comprehension or clunk of comprehension 
failure. Clicks were often accompanTed by feelings of well being and ' 
clunks were accompanied by feelings of tenseness and/or mild anxiety. 

- Another effort (Baker , 1978) to investigate the Automatic Monitor in^'^' 
Mechanism consisted of a. research plan with two phases. To implement the 
f i r%t phase of^ the research p.l^n, t«n three-paragraph passages dn worl d ; 
history topics were written with deliberate conf us ions introduced into 
the middle paragraph of each passage, types of text confusions incl uded • 
(1) pronouns wj thjindef ini te referents,. (2) linguistic markers ihcorrect/y 
signal ing; the nature of -the- tex't^ that fol lows; e.gv', using ^'therefore"' 

is appropriate,: and .(3) presentation of new infor- 
mant ion -rel at ing to , a previously ;developed topic whi?ch is i neons i*5':tent , * 
wi th. earl ier /information. . Each; of the three types involve either a»main 
point t3r a detail Fn the- ^passage . Thi rty-three college students were in- 
structed to!, read the passages as editors might and to put a question mark 
by andAor explain any confusions they detected. ^ Hopefully;, these 'insti^uc- 
tions encouraged the students to engage in a high degree Oi metacomprehen- 
sion. ' Resul ts showed that only six percent of the students were able to 
detect all of the planned confusions. Furthermore, the average percentage 
of the confusions detected per student was only 'thTrty-four percent, whitrft 
was lowfer than, expected . Two plausible^ explanations were posed to account 



for this low percentage: (l) Some of the passages dealt with content' 
that was difficult to understand (such as some o,f the philosophical aspects 
of history), whi ch d imin ished the sal i ent. features of the planned confu- 
sions; (2) Students seemed able to impose plausi ble a'l ternate meaning onto 
the target areas of text, and in so doing*, apparen.tly^ stJTveiT^a^^^^^ confusions 
they might have expe'^rienced. _ " • ' 

' r?<. the ^second' phase^'of^he plan,' 26 colljge students were 

instructed .to, re^^ the^passages defecr I bed above and \yere aljso told that . 
they would*' receive a subsequent comprehension test over the material. 
The test had one- i tern (th^ ^target Item) related to the confusion and two 
-items fr'om other places, fx)r each of the ten texts. /These students wr' 
pot-informed that any of the texts had pi anned tonfusi ons . 
; Results from the comprehension tests showed that the presence or ^ 
absence of confusions appeared to have n^ effect upon the performance of\ 
the non-targei. items. When reading the target i'tems , or the' ^^conf usi ng" 
paragraphs, fifty^pne percent responded with a recognized verbatim re- 
sponse from the passage, (which is evidence, that the inconsistency was^ 
not noticed'and/or adl^quateLy resolved) , vjhi le forty-f ive percent recogr 
nized the '^correct*' -knswer (whi ch Is evidence of detecting an Ynconsis- 
tency). :Four percent chose a third alternative which was' neither ver- . 
. bat im from l.he text nor a "'correct" answer. . 

If subjects read a '*'consi stent*' passage seventy-six percent ;re-' 
sponded Vrfitlf^the correct^^alternative, eighteen percent gkye the "incon- . 
si stent" choice, and five percent chose the other alternative. In general, 
subjects responded more frequently; with verbatiminformatlon when it was . 
consistent with. the passage . (76%) ,vhan whenMt was inconsistent (5t%). 
This difference indicates that many students were aware of the confusiof>sj 



in the text , (at some level of processing) whether or not they could state 
so'eXpl jcytt'ly. • * ; 

In a seco(id study of f base Two (briefly discussed earlieT unrJer 
Information Gathering)', 37 stibjec^s were presented a subset of'the passages 
used previously: \ two-passages contained coafusions, e.g., contradictions 
involving the ma'i n point of a ,parJs(^raph , wh i 1 e two involved con trad ictipnl 
abdut passage details. ,The material's were presented sentence by sentence ' ' 
on the' PLATO^ computer-assisted instruc^ibn systeni terminal screen. The \ 
students controlled the amount of time tHey spent on each sentence'. They 
were also given the opportunity to ^'rnove around" in the lext; .that Is, " r 

they. could look back or look ahead at any section or the passage when they ^ 

so desi red. ' • ^ I . ■ . ■ 

i ' 

Another manipulation in the^^xp^riment involved the position of the 
contradictory target statement relati ve to i ts dtsconfi rmrpg coh.text ."^ 
the caise of the>Tia,|jijpoint pas^^^^ the contrad i ctory statemer>t was 
either the first or last sentence.In the paragraph. TherVemaini ng jsieia- ^^y-'^^' 
•V tences„provided information that Went against th^^ statement. For detail 
^.passaiies, the context for the contradiction was but a single sentence, and 

• jf' • > ■ . ' ■ - , y • ■ ■ . • 

'--both were embedded ' w5 thi n the paragraph. Thus, the manipuhation involved 

^/-K^ / ' • " ■ , 'v ■ . ; 

•reversing the order; of '^hose two sentences. It was hypothesized that 

^ patterns of reading behaviotr depended on the. position of the contradiction. 

' . ' ' " - / '■ ' 

After reading the passages, subjects were given a series of on-l/ne 

"i /' . * 

.questions designed to assess their awareness of the contrad ictioQ . T They 
were. first asked to decide which of two a 1 ternat i ves was mo.st consistent 
with .each passage. The alternatives were paraphrases of either the 
^ contrad ic to r(y target. or its corresponding consistent controj; statement. ' 
Depending on which answer subjects gave, they were automatically branched' ' 



> 



by the computer to further questions probing their interpretations o^ the 
passages. . * • 

• A significant result of the study was a Paragraph T^pe (main-poiht 
« vs. detai 1 ) by. Target Type (contrad ictory or cons i stent) i nteract ion . 

* 9 . 

Subjects spent more time reading the entire paragraph when a contradiction 
was present if the contrad i et ion involved a main point. However, on the 
detail passages:, subjects spent more tim^ reading the paragraph when the 
target statement was consi stent rather than contradictory. Thi^same 

pattern was also observed for (l) the amount of time spent pq the target 

sir- ' r . ' ' ■ . .I- ■ ' ' 

statement k) one an,d (2) for the number of. lookback^ on the. entfre para- ^ 

\ ■ ' ■ ■ ■ ■ ' . ' 

n^raph. Thus, the contradiction manipulation had t|ie ant i ci pated resul ts 

. only on main-point paragraphs. One plausible explanation is that subjects 
did in fact notice the contradiction on details buj:. decided to gloss over 
it rather than attempt to resolve it. Thus, they actually spent less time 
study ing the material than wh^n it was written to make perfect 1 y good sense 
Di f ferences betweeiV ma i p point and detail passages were alsd apparent 
in the question-answering- data. Overall, accuracy^was greater onimain- 
pbjnt questions thain deta i 1 , whe re accuracy is defined as the correct-,.., 
selection of the consistent, noncontradictory alternative. This held 
/''^true regardless of whether the passage was consistent or contradictory. 

. Hpwever, subj^ct^ vTfere more accurate ^when the,y.had read the consistent 
passage. vThi s \Litcome I s -not at dll surprising sines evef> if subjects 

.^had 46tected"the contradiction, there would be a convl i ct between what 
they actually re^d a^nd what the correct answer should be. 



I Final ly, analysis of the time required to make a correct response 



^ .Showed that subjects required considerably more time answer i ng_deta i 1 
/questions when 'a contradiction was /present. However , there was H-ttle 



difference in resportse times on main-point questions, suggest i ng that if 
. subjects had resolved the inconsistency and ide^ptified the real main idea 
of the: paragraph, they did so daring initial redding. 'This interpretation 
is consistent with the observed differences in reading behavior on main- 
•point passages. ^'v \ 



As IS obvious from the above accounts of research on the Automatic. 
Monitoring Mechanism, the "di scovery process "i s j ust begi nning . The 
research difficulty i s^ compounded by the fact ,that many students' are 
generally uhable'tp keep;,> record of their mon i tor ing^ aci tvi t ies without 
having the record^ keep i ng interfere wi th* the. memPtorin^. Consequently, 
we have had to use, the indirect technique of having stiidepts study mate- ' 
rials with planned confusions. To date, we have\pnly a \few resul ts : all* 

' -..i" . ■ \ >, • 

of 'which lead us to believe that* the* Automat i c Monitoring Mechanism is 

. • ■ ■■ ■■ \ ■ 

quite complex, perhaps more so than we anticipated. \ It is abU to dis- 

: . ■ ■ ■ . ■ \' 

ti^jguish between confus;ions whidh are po^tentTally serious to successful 
comprehension, "such as those involving a main point, and less serious ones 
such as .those involving p. -sage details. However, confusions involvfng 
the improper use of transition words;, e;g., "however and therefore , never 
seemed to trigger the>mechanism. The research paradigm, however, seems 

, . r ' *i / • ' ■ ~. \ 

solid and it should, have additional payoff in the future 

' ■■ . * .'• ^ ■ . . ; ^ . ^" . ' 

" After the epi sode has been interrupted by either the response-demand 
event or the Automat ic Moni tori ng MechanFsxn and somf response has been 
no,ted, the. student makes a decision regarding the appropriateness of the ^ 
response. Making this decision is.^ at best , a diff icul t task and a. reair' 
fistic decisiori depends, to ^a large extent', on the expll ci tness^of the S 
criteria.^ After making the decision, rules concerning what-to-do-'^iext / 
must be applied. , ^ ^ S 



Decisions of What- to-Do-Next ^ 

Outlined below is the tentative model of how ski lied readers manage 
this what-tO'do-next question. These cond i t ional statements are the 
consequence of ^ logical analysis, based on interview dala., of the 
actions students take when they fail to comprehend. 

1. If a reader reads.:^somet|ii ng that is'not uriclerstood, some imme- 
diate action may occur dr the information may be stored in 

. . ; . . . , • ■ ' I ■ 

/* memory as a pend'rng question. | 

2. If the reader stores i t as a pending question, |a possTble . 
meaning (usual IV ^e) may be formulated, which^ is then ^ 
stQred as a tentative hypothesis. | 

. 3- If* the reader- forms a pending question, reading continues. 



cjue^tions, or 
s after the , . 



If a triggering event; (i . e. , too many pending 
repetition of the same pending ques^tion) occu| 
reader forms the pending question, sortie addit^lonal strategic, 
action may be taken. By agreeing to^^take^ some strategic 
action, :.the 'reader 'may : • - I ^ ' • 

a. Reread some portion of , the text in ordfer to collect 

j ' 

5wer a 



more information' that will either answ'er a pending 
•question oKform a tejitative hypothesils that is 
related to a pending question} )^ f': 

b. Jump ahea d in the text to see if there; are headings 

' - ->v • ■ ' • V- j 

or paragraphs that : ref-er- to the pending question 



v\(hich might answer vit; L 
c« Consult an outside source (e.g., dictioi^ary, glossary, 
. encyclopedia, -^expei^t) for an answc-T to a\ pending^ . 

. - ■ )■ ■ \ ■ ■ 

question; ' : , \ 



, ' * d- Wake a written record of a pending question; ; 

• \ ^ . e. Think/reflect about the pendiilg question and [relate 
information that hq/she has in memory; 
f- Qui t readirrg the text. ! 

5. The reader may 'continue to read from the point in which compre- 

■•• . ■ • ■ 

hensiorr faijure was last epcountffred whether the strategic action 
is successful 6r not. , 
And so, the process continues in which the student manages episddfe 
^fter episode d$ each section of prose is processed. 

Stage lit: Post-reading Activities • ♦ 
In this stage, activities are employed by the student to enrich the 

t V . . . r. 

learning that has already taken place, to increase the probability that 
what "Has been lo.'arned will bd' retained, and. to Generate alternate texts 
(e.g., notes ^n.d outlines) that will be i;5efurl/hen the material has ^to 
be studied again later.* j 

In what Pojt.-reading act i,vi ties should students_engage? In one 
SBnse, any of the organizational (outline, mnemonics), translat ional 
(paraphrases, generate questions), a*nd/or repetitional (recitation, " . 
rehearsal) schqmes can help students remember what they have learned. 
However, there is the chance that to engage i n'these schemes will burden 
the students with unnecass^ry busywork and they wfl 1 gain mastery of 
information that- is unrelated to the criteria. Tortu'nat^ Weinstein and 

Dansereau are researching interesting strategies related to this partic- 

■ ' * >. 

ular. phase of -study which are. discussed in other chapters of this book. 

These techniques have a very exti ting, potential of serving the student 

■ ''^ \ " • ■■ . ^ 

weM'during this stage of study.- >' c - 



-2A- 

At our Center, we have developed a new techni|que that Is also pote^n- 
■ ■ ■ tlally useful during.this Post-reading stage. The! techn ique is^described 

as only "potentially" useful because it has not yfejjt been field tested with 
a large population of students. However, the underpinnings of the tech- 
n ique. seem sound and are worthy of discussion here|J 

As is apparent in this chapter, studying involves complex behaviors 

:• " " ' . ■ ■ !; ■ . • 

in which the student imposes meaning on text materjial. through ci series of 

self-directed instructional episodes. Studying isjnot seen as a series 

of mechanical steps, but rather an interactive probers involving a stu- 

-dent's prior knowledge,; textbooks ,^ study guides, e|c. it is a process in 

which the student's comprehension of a text topic "js expanded, sharpened.:, 

made more relevant (or whatever else the studying criteria demand). 

When thinking about techniques to use- in teaching students this complex 

process, a glaring hole in traditional study procedures i s .apparent . 

That i.^, there is no efficient way for students to concisely represent 

or record the meaning or the relationship^among ideas found in lectures, 

notes, or text materials. Notetaklng and outl ining strategies are either 

too simpl ist ic and insuff icienti for capturTng the^ relationships, or they 

are so elaborate that employi ng ithem is an inef fJcient use of ^student time. 

Consequently, ^ new technique was designed ;whi<:h sti^e'^sses the impor- 

; tance of students' ability to link ideas together and to represent the 

' : nature of the: relationship betwed^ the ideas. /jSs an illustration of .the \ 

„ inadequacy^^df the tradi tional techniques, butliriins only e?iables students M 

_ to detect which sets of ideas are subsumed under: others; however, outlines 

do not provide an adequate framework for showing why they are subsumed. 

Are the subsumed items merely properties of theijsuperordinate ones? Or, 

*• J. " - ■ ^ - / ^- - "^-^ ■ !| * • . 

are they the outcomes of the superord i nateVtems'? 
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Some of our early thoughts about solutions to this problem came 
from an article by Hauf (1971 ) , and from the work of John Merritt (1977) 
at^the Brl-tish Open University. Hauf (1971 ) -describes a mapping technique 
In which students can organlze-the main ideas from a text passage without 
the usual constraints found in a formal outline. She ad-ocates that the" 
central idea he written near the middle of a note page and the subsidiary 
ideas be attached ,Jn a concentric fashion, resulting in a product that 
resembles^a city map. The ma i n J i f ference between this technique and 
. outlining is that it breaks, down the I'^f t-to-<.ight and top- to- bottom con - 
. ventions usfjd in formal outl ines. >^oweve^, white it allows students to 
represent' more faithfully the of ten complex interrelationships among ideas 
In a passage, it, like the outl ihe, of fers no easy Way of expressing the 

■ V 

nature of the relationsjiips among the ideas. 

' ** . ■ ■ V 

•Jn addition, some (nterest i ng wot*k by Merritt (1977) influenced the 

■ '* ' 

development of our new t|chaique , a 1 so called mapping. Merritt and some 
of his colleagues propose^d an interest Fng hypothes i s ; For many, if not 
most, text passages, there is a preferred technique for succinctly repre- 
senting the! r meaning. For example, some passages are best represented by. 
ei'ther a Venn diagram, a flow .chart, a double-entry (check list) table, or 
a sketch. Data from the i nt rospect ion act i v i t i es of Merritt's team and 
from .classroom^ students help*support his hypothesis. Quit^ often students 
acting independently will design similar text representations from the 
same text passage.^ These outcomes suggest that there is some consistency 
in the way text can be repres^epted. However, students woul d have-lo^ be. 
.taught d wide range df diagramming and^charting ski 11 s * i n order to repre^^ 

' ■ ■. - ■ * 

sent a variety of .text. 



Any new mapping -scheme, then, should haveShe flexibMJty and sim- 
plicity .j>f the one discussed by. Hauf.{J9yi), but also should be capable of 
succinctly representing^ a variety of relationships. Our new technique seems 
to have these characteristics. To use this new scheme requires that the 
student learn a set of relational ccj^nvent ions (symbols), which at the 
V simplest level indicate how twct-ideiars are related, but at a text level can 
show the complex relationships>^am6iig^any ideas. This: scheme hns seven 
fundamental relationships between' two ideas., A and B: when, B is an instance 
ofrA, B is a property or character^! sti c of A, A is similar to B, A is greater 
or less than B, A occurs' before b[ A causes B, and, A is the negation of B. 
In addition, two special relatibnyiips show when Idea A is am^' important 
idea, or a definition. The logical connectives and and or are also^used. 

An important feature of the maps, as Mlustrated in Figure 1, is that 
the shape of the map represents the organizational pattern of the ideas- 
For example, when the map baSed on text material is character ized by a series 
of embedded and segmented boxes, such as" the, box headed by "mater i aKposses- 

sions** in Figure 1/ then the text is describing and giving examp'le's of some, 

^ i — — — — . ^1 

Insert Figure 1 about here ; 

perhaps,, fundamental ideas. Chapters. in many i ntroductory level textbooks 
have these characteristic maps. On the. other hand, when the map shows a 
-serjes of boxes connected by arrows, such as those on ^e right side of 

- ' - * .1 

Figure 1, then the text i s concerned wi th a set of procedures (as In a 
technical manual), a chronology of events (as in a history text), or a ||:ausal 
"xHain of -events (as in a concluding section of a chapter in a sociology text)., 
---—When and how often should students map ideas? Our experience with 
the technique is too limited to say for sure. However, we do know that 



mapping entire cfi^ters, while- often an enT^ghtening process, requires a 
great deal of time and real istMcally, the student learns more from' the 
exercise than is often necessary to know about the chap'teV content. So. 
we are ad;?ocatina that short map^s be constructed for each, important task 
outcome, i.e., one for each item that might be on a" chapter test. Roughly 
this translates into one map for each entry on«the study';^^guide, as'de- . 

scribed in an earlier section. * 

. --^ '**'." 
T" Summary 

The process of studying is a criteria-related, self-directed form of 
reading text. The activities in t,his process ire discussed, in three 
phases. Pre-reading, Dur i ng _Beadi ng and PoAreading». Tre-reading activ- 
ities require the student to clarify the criteria for study. This is 
.accomplished by coHectin^ previously administer tests, lecture notes '\ 
and other evidence, related to the criterion event, such as an exami hat ion 
and then using these to construct a study guide by writing entries of key 
concepts from them onto appropriately labeled pages. Also during the Pre- 
reading .stage, the student surveys the text in an effort to determine how 

rtiuch of thfe text/topfc is already know, how interesting it is, and how 

\ . < ' ' , ■ ' 

difficult or time consuming it will be to learn what needs to be known. 

The During Reading sta^e is characterized by periods of ext'=»nded 

• • ; /. " ^ •■■ " 

reading i n wh i ch the students^ mon i tor their understanding of the text 
meaning an(^ attempt to remediate any important comprehension failures 
as they opcur;. When add i ttonal» key* concepts are encountered in the text, 
they should be enteredTonto the study guide. ; 

.FinalVy^^in the Post-reading stage , students employ ;act ivi t ies to 
augment what has already been learned, to increase tbe probabi li ty that - 
the learned (Material wil 1 be retained, and to generate useful a 1 ternate 
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,^f^rms oT the text materials. Concepts which have a high probability of 

being tested on a subsequent , exam, e.g., those with entries on the stody 

. > , • - . . . ° ■ ' • . ■ 

•guide, should receive special attention by mapping the rett^ted ideas. 
Mapping is an elaborated outlining scheme in which not onl^. related ideas 
are juxtaposed, but the nature of their relationship is in^^c^d^by a 
symbol system. . a f 
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